1 



PHt^oo-o4G7C;: ;;L r! j 

•vJo 



.. i 



WORLD INTELLECTUAL PRt>PER\TY"OROANlZA'TI©N 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 : 


A2 


(11) International Publication Number: 


WO 99/04555 


H04N 3/15 


(43) International Publication Date: 


28 January 1999 (28.01.99) 



(21) International Application Number: PCT/IB98/00917 

(22) International Filing Date: 1 1 June 1998 (1 1.06.98) 



(30) Priority Data: 

97401700.6 15 July 1997 (15.07.97) EP 

(34) Countries for which the regional or 

international application was filed: FR et al. 



(81) Designated States: JP, KR t European patent (AT, BE t CH, CY, 
DE, DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, 
SE). 



Published 

Without international search report and to be republished 
upon receipt of that report. 



(71) Applicant: KONINKLUKE PHILIPS ELECTOONICS N.V. 
[NL/NL]; Groenewoudseweg 1, NL-5621 BA Eindhoven 
(NL). 

(71) Applicant (for SE only): PHILIPS AB [SE/SE]; Kottbygatan 7, 

Kista, S-164 85 Stockholm (SE). 

(72) Inventors: JASPERS, Comelis, Antonie, Maria; Prof. Hol- 

stlaan 6, NL-5656 AA Eindhoven (NL). DELAGE, Eric; 
Prof. Holstlaan 6, NL-5656 AA Eindhoven (NL). HOS- 
TIOU, Phillipe; Prof. Holstlaan 6, NI^-5656 AA Eindhoven 
(NL). 

(74) Agent: STEENBEEK, Leonardus, J.; International Octrooibu- 
reau B.V., P.O. Box 220, NI^5600 AE Eindhoven (NL). 



(54) Titie: COLOR SAMPLE INTERPOLATION 





G3 




61 


R/B 


G2 




G4 





(57) Abstract 

In a method of interpolating a color sample in a signal (RGBin) having alternately colored samples, the missing color sample is 
interpolated in dependence upon neighbouring color samples (Gl, G2, G3, G4) of the same color (G) as the color sample to be interpolated, 
and a differently colored sample (R/B) from the same location as the color sample to be interpolated. 
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The invention relates to a method of and a device for interpolating a color 
sample in a signal having alternate colored samples, and to a camera comprising such a 
device. 

5 

It is, inter alia, an object of the invention to provide an interpolation 
aimed at furnishing a high color signal resolution. To this end, first and second aspects of the 
invention provide an interpolation method and an interpolation device as defined in claims 1 
and 15, respectively. A third aspect of the invention provides a camera as defined in claim 
10 16. Advantageous embodiments are defined in the dependent claims. 

In a method of interpolating a color sample in a signal having alternate 
colored samples in accordance with a primary aspect of the present invention, the missing 
color sample is interpolated in dependence upon neighbouring color samples of the same 
color as the color sample to be interpolated, and a differently colored sample from the same 
15 location as the color sample to be interpolated. 

These and other aspects of the invention will be apparent from and 
elucidated with reference to the embodiments described hereinafter. 

20 In the drawings: 

Figs. 1A and IB show an RGB and a YeGCy Bayer filter, respectively; 

Fig. 2 shows the sample structure of the RGB pixels and the pitch of the 
GRB colors obtained by an RGB Bayer filter; 

Figs. 3 A and 3B show a theoretical and a more realistic Nyquist domain 
25 of an RGB Bayer filter, respectively; 

Fig. 4 shows a red or blue pixel at the position of a missing green pixel; 

Figs. 5 A and 5B show the near- white area for two different values of the 
parameters SmartGainR and SmartGainB; 

Figs. 6 A and 6B show two configurations of a white balance control 
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is repeated at multiples of the sample frequency of each color. The multiple sample 
frequencies are located at equal distances in a two-dimensional array. 

Figs. 3 A and 3B show the Nyquist domain corresponding to such an array 
with a very limited number of sample frequency points, because this number is theoretically 

5 infinite. In order to avoid aliasing, each spectrum around a sample frequency point should 
not overlap with the spectrum of its neighbor sample frequency points. If this is true, the 
Nyquist theorem is fulfilled, i.e. the incoming frequencies of the scene, supplied via the 
optical system and the integrating light-sensitive part of a pixel, should be lower than half the 
sample frequency of each color. Frequencies supplied outside this Nyquist domain will 

10 certainly cause aliasing. This means that the maximal resolution of each color is determined 
by half the sample frequency of each color. For Red and Blue, the maximum resolution in 
the horizontal and vertical directions is therefore fsRB/2 = fs/4, and V2*fs/4 in the diagonal 
direction. For Green, the diagonal resolution has a maximum of fsG/2 = fs/v / 2 and fs/2 in the 
horizontal and vertical directions. Because of their symmetry, the Nyquist domains of the 

15 Red, Blue and Green colors can be drawn in a single diagram, showing only a quarter. R/B 
indicates the Red/Blue domain and G indicates the Green domain. The desired domain is 
indicated by the 1/4 circle, while the full square corresponds to the domain of a 3 CCD 
camera. 

It is possible to compare the Nyquist domain of a single RGB Bayer 
20 sensor with the square domain of a 3 CCD camera in which each sensor has the same 
sampling frequency *fs' as the Bayer sensor. Since the human eye has a rotationally 
symmetrical resolution, a more realistic domain for comparison purposes is the circular 
shape. This desired domain can be regarded as being representative of a full VGA or XGA, 
or any other format, for each RGB color. 
25 As has been illustrated in Fig. 3B, it appears that the color Green near the 

Nyquist frequency fs/2 does not truly fulfil the idea of the Nyquist theorem, i.e. there are 
clearly visible distortions. The same can be seen for the Red and Blue sampled colors, but 
then in the diagonal direction. The most annoying aspect is that no distinction of a direction 
is possible: the original scene may consist of horizontal and vertical lines. Considering the 
30 amount of aliasing of a sampled zonepiate, a better approximation of a new domain is shown 
in Fig. 3B. At the new border, only a small amount of aliasing can be noticed. Near the old 
border, the amount of aliasing increases. 

The conclusion is that the Red and Blue signals, but especially the Green 
signal offer less resolution than is suggested by the Nyquist theorem. The amount of Green 
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A very attractive smart Green method especially for digital signal 
processing is offered by sorting the data of G12, G34 and RBc in order of magnitude. The 
center value of the sorted sequence, or in other words, the median value will be applied for 
the reconstruction of the missing Green pixel. Thus, smartG = median { G12, G34, RBc } 
5 The RBc values for a Red and Blue center pixel are: 

RBc = SmartGainR * SmartGawbR * Red value 

RBc = SmartGainB * SmartG awbB * Blue value. 

Note that the product of SmartGainX and SmartGawbX can be sent as one 
parameter by means of a controller to the multiplier which calculates RBc. The need for 
10 applying SmartGainX and SmartGawbX is explained below. Moreover, it will become clear 
why the smart Green processing can only reconstruct the missing Green pixel for near-white 
colors. 

A more complex method, with the same results as the sorting algorithm, 
is offered by the fading algorithm. The default fade value is set at 0.5, resulting in a missing 
15 pixel reconstruction which is equal to the average Green value sigmaG when there is no 
smartG fade action. For RBc, the very same holds as what has been set out above, and the 
direction for resolution improvement is determined with the aid of this RBc value. 

First, the situation is judged for G12 > G34, then 

if G12-sigmaG > minG, then 
20 fade = 0.5*(1 + (RBc-sigmaG)/(G12-sigmaG)); 

if fade > 1 then fade = 1 else if fade < 0 then fade = 0 

SmartG = fade*G12 + (l-fade)*G34 

else smartG = sigmaG 

For the calculation of fade and smartG, it holds that: 
25 if RBc > sigmaG then white dominance ( = vertical resolution improvement), and if RBc < 
sigmaG then black dominance (= horizontal resolution improvement), but if RBc = sigmaG 
then smartG = sigmaG. 

It will not be difficult to imagine that this direction detection algorithm 
will function satisfactorily for near- white signals, where R, G and B have approximately the 
30 same values. For more saturated colors, the reconstruction will start to fail, but from a 

perceptive point of view, near-white, high-frequency parts will be much better observed than 
highly saturated high-frequency parts. This is what makes the smart Green algorithm very 
attractive for application with the illustrated configuration of a missing Green pixel. 

The use of a fader guarantees that, as a function of G12, G34 and RBc, a 
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A simpler fader algorithm was also examined with the aid of simulation 
software. In comparison with the previously discussed algorithm, it causes more distortions 
in the reconstructed smartG signal, is less accurate for smaller signal amplitudes and has a 
smaller near-white area. For this simpler fader algorithm, it holds that fade = 
5 0.5*RBc/sigmaG. 

The near-white area of smartG is understood to be the area in the color 
domain where the Green reconstruction acts satisfactorily. Fig. 5 A shows the RGB color 
gamut with the near- white area. Although it is a sliding algorithm, smartG outside this area 
will be rather quickly equal to sigmaG, the average Green value. In order to achieve a more 
10 symmetrical area, the SmartGainR and SmartGainB parameters are increased from 1.0 to 
2.0, resulting in the near-white area in Fig. 5B. 

To judge the effective smartG near- white area, a 2D zoneplate is applied. 
By varying the RGB amplitudes, an estimation can be given as to what level smartG acts 
satisfactorily. For pure white, the amplitude range is very large for a good smartG 
15 performance and can be varied from at least 10% to 100%. The problem is, however, the 
spread in amplitudes, resulting in a limited and asymmetrical area in the RGB color domain. 
The area can be adjusted to a more symmetrical one by means of SmartGainR/B. 

For a satisfactorily functioning smartG processor, i.e. acting near white, it 
is preferred that the Red and Blue values in the RBc variable are corrected with the 
20 respective white balance gain factors awbR and awbB, i.e. SmartGawbR = awbR and 

SmartGawbB = awbB. Depending on the location of the white balance correction, two block 
diagrams are possible for implementing the smartG processing. 

In Fig. 6A, the white balance correction WBC is performed before the 
reconstruction of the RGB colors. The reconstruction of the RGB colors is carried out in a 
25 processor PROC which interpolates the RGB output signals Rout, Gout, Bout in known 
manner with regard to the red and blue color samples, and, in accordance with the present 
invention, with regard to the green samples. Note that the method of Fig. 6 A can be used for 
RGB color filter arrays only, and cannot be used for complementary arrays like YeGCy 
arrays. In that case, the white balance correction can be effected in the analog signal path of 
30 the correlated double sampling (CDS) and A/D conversion (ADC) circuit (offering a better 
quantization performance of the digital signal), or in the digital path after the ADC. For this 
white balance method, the SmartGawbR/B parameters are equal to 1.0 and do not need to be 
controlled. 

Fig. 6B shows a white balance correction WBC after the RGB and smartG 
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SmartGawbR = EGiwb/ERiwb, SmartGawbB = EGiwb/EBiwb 

in which EGiwb, ERiwb and EBiwb are derived by means of the following 

matrix multiplication: 

ERiwb 1 bll bl2 bl3 

EGiwb =1 x b21 bll b!3 

EBiwb 1 b31 b32 b33 

in which the matrix coefficients bll thru b33 form the inverse matrix 
coefficients of the RGB matrix coefficients al 1 thru a33 used in the camera 
signal processing. However, if false colors occur (to be discussed below), the 
camera matrix coefficients need to be adapted as follows: 



all = all 

al2 = al2*awbR 

al3 = al3*awbR 

a2x = a2x (no adaptations to the green matrix coefficients) 
a31 = a31*awbB 
a32 = a32*awbB 
a33 = a33 

1.4 with white balance and matrix after the RGB processor PROC: 

SmartGawbR = EGiwb/ERiwb, SmartGawbB = EGiwb/EBiwb, 

in which EGiwb, ERiwb and EBiwb are derived by means of the following 

matrix multiplication: 

ERiwb 1/awbR bll bl2 bl3 

EGiwb =1 x b21 b22 b23 

EBiwb 1/awbB b31 b32 b33 



2i YeGCv Baver sensor 

2.2 with white balance after the RGB processor PROC (as discussed above): 

SmartGawbR =1 / (1 + 1/awbR), SmartGawbB =1 / (1 + 1/awbB) 

2.4 with white balance and matrix after the RGB processor PROC: 

SmartGawbR = EGiwb/ERiwb, SmartGawbB = EGiwb/EBiwb, 
in which: 

ERiwb 1/awbR bll bl2 bl3 

EGiwb =1 x b21 b22 b23 
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as "falsecolor" is set to be true. If this condition is not fulfilled, this boolean is set to be 
false. The falsecolor boolean, if true, is used for the false color elimination action itself and 
also for the calculation of the fader value when the false color elimination is executed with a 
fader. If the falsecolor detection boolean is set to be true, then two methods at two locations 

5 are possible for eliminating the false colors. The first method relates to a hard switching 
color killer, the second is a fading version. 

The first location is the same as where the smartG processing takes place, 
the other one is located where the luminance signal Y and the (low-pass filtered) color 
difference signals R-Y and B-Y are available. The following overview shows the False Color 

10 elimination possibilities FC1 thru FC4, each of which will be elucidated below. 



15 



FC1: 
FC2: 
FC3: 
FC4: 



eliminate by switching at location SmartG 
eliminate by fading at location SmartG 
eliminate by switching at location Y, R-Y, B-Y 
eliminate by fading at location Y, R-Y, B-Y 



FC1: False color elimination by switching at the smartG location. 

With the white balance control before the smart Green processing and the 
falsecolor boolean set true, it holds for the elimination action that Red = Gc and 
20 Blue = Gc. In accordance with simulations, the FClevel should be adjusted to 1/16 of the 
full signal range (100 IRE) with 100% modulation depth at fs/2 (i.e. at 8 bits and 256 gray 
levels, the FClevel is 16). 

If the signal-to-noise ratio is about 26 dB, the FClevel should be increased 
to 1/8 of the full range in order to prevent undesired color killing. The signal-to-noise ratio 
25 is unweighed over a bandwidth of fs/2 and is measured on the Green signal. 

If the white balance is located after the smart Green processing, the Red 
and Blue false color results have to be divided by awbR and awbB, respectively, the white 
balance Red and Blue gain controls, in order to prevent Red and Blue from being twice 
corrected to white in the case of false color killing. In that case and with the false color 
30 boolean set true, it then holds for the false color elimination that: 

Red = Gc/SmartGawbR and 
Blue = Gc/SmartGawbB. 

Fig. 8 shows a first embodiment of a color sample interpolator with false 
color killer. The RGB input signal RGBin from the sensor is applied to a processor PROC 
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needed: Red = Gc/SmartGawbR and 

Blue = Gc/SmartGawbB. 

For all of the four elimination possibilities FC1 thru FC4 it holds that the 
false color detection is performed at the smartG location under the same condition: 
5 'if abs(Gc-sigmaG) > FCgain*FClevel, then etcetera*. 

The same adjustments for FCgain and FClevel hold as mentioned before, as well as the same 
transfer characteristic for Red and Blue as a function of Gc. 

With the falsecolor boolean being true, the following action takes place at 
the R-Y/B-Y location: 
10 R-Y = O and B-Y = O, (or U = O and V = O) 

FC4: False color elimination bv fading at the R-Y/B-Y location. 

If the falsecolor boolean is true, the following fading action takes place: 
FCfade = abs(Gc-sigmaG) / FCfadelevel 
IT = (1-FCfade) * U 
V = (1-FCfade) * V 

For FCfade = 1 the color difference signals become zero. 
Inclusive of the dashed FCfade line, Fig. 9A shows the block diagram of 
this FC4 method. The RGB input signal RGBin from the sensor is applied to a processor 
PROC which carries out the RGB reconstruction using the smartGreen algorithm to obtain 
green, and detects the presence of false colors (output boolean falsecolor). The red signal R 
and the blue signal B from the processor PROC are applied to the white balance control 
circuit WBC to obtain a red signal R" and a blue signal B". A matrix circuit MX converts 
the green signal smartG from the processor PROC, and the red signal R" and the blue signal 
B M , into a luminance signal Y and chrominance signals V and U. The matrix MX preferably 
also carries out a gamma correction operation. A false color killer circuit FCK' corrects the 
chrominance signals V and U in dependence upon the boolean falsecolor to obtain corrected 
chrominance signals V and U' which are low-pass filtered by a low-pass filter LPF to obtain 
output chrominance signals Vout and Uout. The luminance signal Y from the matrix circuit 
MX is subjected to a corresponding delay in a delay circuit DL which supplies the output 
luminance signal Yout. As discussed above, a color matrix B (with coefficients bll thru b33 
as set out above) is preferably inserted between the RGB and smartGreen processor and false 
color detector PROC, and the white balance control circuit WBC. A red output signal r and 
a blue output signal b of the color matrix B are supplied to the white balance control circuit 
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of which is added to the luminance signal obtained by the RGB-to-YUV matrix to obtain an 
output luminance signal. In the embodiment of Fig. 9A, the matrix circuit MX comprises a 
conventional RGB-to-YUV matrix circuit which converts the output signal g of the color 
matrix B and the output signals R" and B" of the white balance control circuit WBC into a 
5 luminance signal and the chrominance signals V and U. The smartGreen signal smartG is 
high-pass filtered by a high-frequency white-processing unit I, LPF2, DL2, Al of the type 
shown in Fig. 9B, the output signal Yw of which is added to the luminance signal obtained 
by the RGB-to-YUV matrix to obtain the luminance signal supplied by the matrix MX. 

An evaluation of the false color elimination in accordance with the 
10 invention results in the following considerations. As regards the minimum FClevel of the 
false color detector, the false color elimination requires a relatively large level in order to 
avoid undesired and clearly visible color killing actions which look like defect pixels. In 
simulations at 100% modulation depth at fs/2, a minimum FClevel of 1/16 of 100 IRE for 
the absence of Gc and of 1/8 for the presence of Gc is required. Here, it also holds that at a 
15 lower total modulation depth at fs/2, the FClevels can be decreased proportionally. 

As regards a switching or fading false color killer, the fading version is 
slightly in favor when the perception results of the switching and fading false color 
elimination are compared. The differences can be noticed only in a very few pictures. 

As regards the best performing false color killer location, the R-Y/B-Y 
20 location is slightly in favor when the locations of the false color killer are compared, because 
in the case of an undesired color killing action the LPF will smear it out to a less visible 
artifact. Another advantage of the R-Y/B-Y location is that no divider circuits are needed 
(Red = Gc/SmartGawbR and Blue = Gc/SmartGawbB). 

As regards the influence of SmartGainR/B on the false color killer, 
25 simulations have proved that these parameters, if larger than one, start improving the 
performance of the false color killer as far as less undesired color killing actions are 
concerned. 

As regards only false color elimination in the presence of center Green, it 
is not possible to eliminate false colors at the missing Green pixel. However, without smart 
30 Green, the false color elimination in the presence of Green only offers a reduction of the 
total amount of aliasing of 50%. 

Fig. 10 shows a simplified diagram of a camera comprising a sensor S 
with an RGB Bayer filter in accordance with Fig. 1A, and a parallel 2D Laplacian contour 
and RGB processing for an RGB Bayer sensor inclusive of smart Green. The contour signal 
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holds that only the Green data pixels are sampled, stored and shifted. For all inputs to the 
smart Green processor smartGproc, so also the RBc signal, it holds that they are first 
processed with a zero switch box, resulting in the following full clock speed RBc and Green 
pixel data. 
5 For RBc: 
RORORO 
OBOBOB etc., 
For Green: 
OGOGOG 
10 GOGOGO etc. 

Note that such a zero switch box, for Red and Blue data only, is also used 
at the input of the R/B processor R/Bproc, resulting in the reconstructed Red and Blue output 
signals Ro, Bo. 

The smart Green signal smartG from the smart Green processor 
15 smartGproc is applied to the two row delay contour processor CONTPROC. A total number 
of 4.5 row delays is needed in the embodiment of Fig. 12. 

In the embodiment of Fig. 12, one single smart Green processor 
smartGproc has been used. Fig. 13 shows an embodiment with three parallel smart Green 
processing blocks, in which only 3.5 row delays are needed for contour processing with the 
20 smart Green signal. The smart Green processors smartGproc and also the R/B processor 
R/Bproc have a zero switch box at the input. The zero switch box for the upper and lower 
smart Green block have the same timing. The 3 row-delayed RBc signals are obtained from 
the RBc row delays R/Bdel before the RBc processing. Note that if the smart Green 
processing is executed with the sorting algorithm, each smart Green block needs its own 
25 multiplier for the product RBc*SmartawbX (X stands for a Red or Blue RBc signal). The 
parameters SmartawbR and SmartawbB also include the SmartGainX parameter. SmartawbR 
or SmartawbB is selected in each smart green block and depends on the presence of a Red or 
Blue RBc signal. 

An improved false color detector can be added to the 2D Laplacian 
30 contour processing block CONTPROC in Figs. 11-13. For detecting false colors, the 

smallest possible detection area can now be used. Two different detection areas are needed in 
the false color detector as described above, one for the location where Green is present (Fig. 
7 A) and one for the location where Green is absent (Fig. 7B), but where the reconstructed 
smart Green is available. Since, due to the extra row delays, the smart Green signal smartG 
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Smart green processing is a method of improving the resolution of the 
green signal in the horizontal and vertical directions. Apart from the color reproduction, the 
object of smart green processing is, to approximate very closely the quality of a three-sensor 
RGB camera, in other words, providing true VGA, XGA or whatever size with a single RGB 
5 Bayer sensor color camera. 

The following features are preferably present. The smart Green (= missing 
pixel) reconstruction algorithm by means of the sorting, fading and simple fading algorithm 
for several sensor types like RG/GB- and YG/GC Bayer, RGG/GGB- and RGGG,GGBG- 
types, for two-sensor cameras with a Green and an RB/BR sensor (smart reconstruction of R 
10 and B). The correction of the near- white area with extra gain for the Red and Blue signal in 
the smart Green reconstruction algorithm. The correction of the missing pixel value with the 
white balance parameters. 

A further aspect of the invention can be summarized as follows. 
Red-Green-Blue (RGB) or Yellow-Green-Cyan (YGC) Bayer color arrays suffer from colored 
15 aliasing (false colors) which is caused by the limited Nyquist area of the RB or YC pixels, 
half the contribution of the total aliasing can be eliminated by means of a false color detector 
using the center Green pixel and the other four diagonally surrounding Green pixels. No 
false color detection is possible at the missing Green location. However, when using the 
missing pixel reconstruction as described above, the second part of the colored aliasing can 
20 be eliminated with the same algorithm and using the horizontal and vertical surrounding 
pixels. The result is that the colored aliasing in a test scene like a zoneplate is completely 
killed. In normal scenes, not all but much aliasing is killed. 

The following features are preferably present. The elimination of false 
colors at the location where Green is present and where Green is absent, inclusive of the 
25 adaptation of the false color levels for each. Note that the smart Green reconstruction 

algorithm is required first at the missing Green location. The switching and the fading color 
killer method. The adaptation of the false color killer level as a function of the overall 
Modulation Transfer Function of the lens, optical low-pass filter and light-sensitive window 
of the sensor. The adaptation of the result of the false color killer when it is executed before 
30 the white balance. The application of a diagonal optical low-pass filter for higher optical 
resolution in the case of smart Green with its false color killer. 

Another aspect of the invention can be summarized as follows. An 
improved contour processing and an improved false color killer, both with the smart Green 
signal for RGB Bayer sensors, are based on the following considerations. The Nyquist 
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CLAIMS: 



1. A method of interpolating a color sample in a signa 1 (RGBin) having 

alternately colored samples, the method comprising the steps of: 

providing neighbouring color samples (Gl, G2, G3, G4) of the same color 

(G) as the color sample to be interpolated; 
5 providing a differently colored sample (R/B) from the same location as the 

color sample to be interpolated; and 

interpolating the color sample to be interpolated in dependence upon the 

neighbouring color samples (Gl, G2, G3, G4) of the same color (G) and the differently 

colored sample (R/B) from the same location, to furnish an interpolated color sample. 
10 2. A method as claimed in claim 1, wherein said interpolating step comprises 

the steps of: 

determining a horizontal average of horizontally neighbouring color 
samples (Gl, G2) of the same color (G) as the color sample to be interpolated; 

determining a vertical average of vertically neighbouring color samples 
15 (G3, G4) of the same color (G) as the color sample to be interpolated; 

furnishing a median of said horizontal average, said vertical average, and 
said differently colored sample (R/B) from the same location. 

3. A method as claimed in claim 1, wherein said interpolating step comprises 
the steps of: 

20 determining a horizontal average of horizontally neighbouring color 

samples (Gl, G2) of the same color (G) as the color sample to be interpolated; 

determining a vertical average of vertically neighbouring color samples 
(G3, G4) of the same color (G) as the color sample to be interpolated; 

calculating a weighed average of said horizontal average, said vertical 
25 average, in dependence upon said differently colored sample (R/B) from the same location. 

4. A method as claimed in claim 1, wherein said interpolating step comprises 
the step of multiplying said differently colored sample (R/B) from the same location by a 
white balance adjustment factor before said differently colored sample (R/B) is taken into 
account. 
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15. A device for interpolating a color sample in a signal (RGBin) having 

alternately colored samples, the device comprising: 

means for providing neighbouring color samples (Gl, G2, G3, G4) of the 
same color (G) as the color sample to be interpolated; 
5 means for providing a differently colored sample (R/B) from the same 

location as the color sample to be interpolated; and 

means for interpolating the color sample to be interpolated in dependence 
upon the neighbouring color samples (Gl, G2, G3, G4) of the same color (G) and the 
differently colored sample (R/B) from the same location. 
10 16. A camera, comprising: 

a sensor (S) having a color array having alternately colored color elements 
for providing a signal (RGBin) having alternately colored samples; and 

an interpolating device (RGBproc) as claimed in claim 15. 
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